Papers with noisy SQuAD
MaskLoRA: Low-Rank Subspace–Induced Token Masking for Efficient and Faithful Language Models (2026.findings-eacl)
Copied to clipboard
| Challenge: | MASKLORA is a plug-and-play masking mechanism that can be used to mask lowrank subspaces. |
| Approach: | They propose a plug-and-play masking mechanism that transforms PEFT's lowrank subspace into a faithful token selector. |
| Outcome: | The proposed masking mechanism matches full-model accuracy while yielding 1.3-2.6 speedups. |